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The MTB as a MMsurt of General Academic ability: 
Implications for Toachor Education 

Introduction 

Toachor competency testing is not a now phonomonon nor is it 
a now controversy iu tho field of toachor education (Void, 1985). 
In the 1920s and '30s teacher competency testing was the rule. 
With ths demand for accountability and reform since the mid-1970s 
policy makers and state legislatures across the country have once 
again turned to teacher testing in order to show the public that 
action is being taken to improve the educational system and the 
problem of poorly trained teachers (Flippo, 1986). 

A recent survey of the American Association of Colleges for 
Teacher Education (1988) indicates that almost every state has 
some form of certification test as a condition for state 
licensure. Effective truly 1, 1987, the Ohio State Board of 
Education adopted new requirements for teacher education and 
teacher certification (Ohio 8BE, 1989). This included the 
implementation of competency testing in Ohio. The certification 
examination selected by f-he Ohio State Board of Education is the 
MTE, formerly the National Teacher Examination from the 
Educational Testing Service (ETS) , a test that was first 
developed in 1940 by the American council on Education (Void) and 
first used for certification purposes in 1945 by South Carolina 
(McDonough and Wolf, 1988) . 

The NTE is the most widely used of the standardized tests 
for prospective teachers and is used in 21 states at this time 
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(AACTE) • It consist! of s Cors Battsry tsst and a spsoialty Area 
tsst (ETS, 1983) . Ths Cors Battsry contains thrss ssparats 
tssts, saeh two hours in lsngth: Communication skills (CS), 
Prof sssional Knowledge (PR) , and Osneral Knowlsdgs (OK) . Each of 
thsss ssparats tssts contain four, 30-minuts ssctions. Ths CS 
tsst mcasurss listsning, rsading, and writing skills. Ths OX 
tsst contains a litsraturs and fins arts section, along with 
ssctions on mathematics, science, and social studies. Ths PR 
tsst examines ths tsachsr candidate's knowlsdgs of tsaching 
principles and techniques. Ths Specialty Area is also two hours 
long and focuses on spscific content material and on pedagogical 
knowledge. NTE has 42 diffsrsnt Spsoialty Area examinations. 

Ohio requires only the PR and OR tests from ths Cors Battery 
and the Specialty Area test for its tsachsr candidates. Ths 
cutoff scores for ths PR and OR tssts havs bssn set at 642, which 
is at approximately ths loth psresntils nationally. Ths 
rsspective cutoff scores for ths Spsoialty Area tssts vary a 
grsat dsal. Ths process of determining ths cutoff scores in Ohio 
was rathsr arbitrary. Policy makers looked at the scores in 
othsr Midwestsrn statss using ths NTE and arrived at a mean 
cutoff score. 

Ths NTE Policy council claims that ths exams msasurs 
"knowlsdgs and skills dsvslopsd in acadsmic programs for ths 
preparation of tsachsrs and othsr professionals*' (ETS) . They 
stats that nsithsr statss nor schools should use ths NTE as a 
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single criterion to assess teacher candidates. Ths test is 
primarily a measure of academic skills that have supposedly been 
acquired in the teacher training program and not a measure of how 
well those skills are applied in the classroom. Such a paper and 
pencil test cannot possibly capture the complex process of 
teaching; such a test is limited in what it can measure and may, 
in fact, be counterproductive to the complex process of classroom 
teaching (Shepard, 1989). 
NTE Results at Ohio state 

Ohio state University (OSU) first began using the NTE during 
the 1981-82 academio year and has been gathering information on 
it ever since. NTE also began providing institutional summary 
reports in 1986 to the different colleges and universities for 
which teacher candidates reported having had received their 
teacher training at these institutions. These reports provide 
only aggregated information but allow us to compare how OSU 
students perform on the NTE relative to other schools. 

In the aggregated institutional reports which NTE provides, 
OSU students consistently score in the highest fifth of 
institutional scores (Loadman and Devil le, 1990) . NTE 
categorises sohool means according to the highest fifth, middle 
3/5 and bottom fifth of institutional mean scores. 

As mentioned before, the state of Ohio recently mandated the 
NTE for teacher certification. The state established outoff 
scores of 642 for the two tests, Professional Knowledge and 
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General Knowledge. Had this cutoff score boon in of foot last 
year, i.e., for 1988-89, only ono OSU student would have failed 
to achieve it. However, the results of the two NTE tests so far 
for 1989-90 show that already three students have failed to 
achieve a score of 642. The most recent scores that we have 
received from NTE are from the March 3, 1990, testing date. The 
institutional summary results of OSU mean scores are: CS=667, 
GK=666, and PK=666. These scores are well above the mandated 
cutoff scores for certification in Ohio. Nevertheless, we will 
need to watch the scores more closely, especially now that the 
NTE is required for certification. 

With regard to the specialty Area tests, the sample size 
from Elementary Education (EES) was the only group large enough 
to provide stable data from aggregated means. The EES scores 
were consistently in the top fifth of institutional means and 
well above the Ohio established outoff score of 510. From last 
year's group no OSU Elementary Education test-taker failed to 
attain the cutoff score. 

In 1988-89, ninety-one OSU students had their NTE scores 
sent to the College of Education, meaning that these students 
could be identified individually. Additional measures such as 
GFA and ACT scores could be obtained for many of these students. 
Of these students, 69% of them were female, the lowest percentage 
since data has been oolleoted on the NTE. Eight graduate 
students were included in this sample. The mean GPA of the 91 
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■•If -reporting students was 3.23, ranging from 2.12 to 4.00. 
Their mean ACT score was 22.76, ranging froa 13 to 31. The mean 
NTE scores for this group was very similar to the overall 
institutional summary reports, including the Elementary Education 
Speoialty Area score, again the only group large enough from 
vhioh to obtain stable data (Table 1). 

Table 2 gives a picture of the descriptive make-up of OSU 
students who have taken the NTE since 1982 and reported their 
scores to the college. The mean CPA and ACT are consistent 
across years with last years soores being the highest. This is 
probably due to yearly fluctuations in the sample data and to the 
fact that graduate, students were inoluded for the first time. 

Table 3 summarizes the results of the core battery test 
across the years. The scores were converted to z-scores to make 
the comparison possible. Again, the scores are consistent with 
last year's scores being somewhat higher than scores from 
previous years, it is clear that as a group the OSU teacher 
candidates score above the national norms. Nevertheless, eight 
candidates (1.2% of all students) since 1962 would have failed to 
score the necessary 642 on the PK and/ or the OK Core Battery 
test. These eight students also had mean CPA's and ACT'S below 
the OSU averages. 

Over the years the Elementary Education group was the only 
or»e with enough self-reported scores to yield a stable picture of 
its scoring pattern. The EES scores have also been consistent 
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sine* 1985-86 / the year when data was first obtained for the 
group. During that tin* two students would have failed to soore 
the necessary 510 on the specialty area examination, this being 
1% of these students. 

It is interesting to see how significantly the different 
academic measures correlate with one another (Table 4). One can 
view the measures of academic ability as follows: ACT represents 
academic ability at the time of entry or before teacher 
preparation; GPA is the academic performance of the students 
during their teacher preparation; and the NTE measures academic 
skills at the time of exit from the college. 

It is especially interesting to note that the highest 
correlation is between General Knowledge section of the NTE and 
the ACT composite score, .78. In general, the high correlations 
are among the NTE measures and between these measures and the 
ACT. This seems to indicate that such tests assess general 
academic knowledge and test-taking ability. 

When regression analyses were performed on the data it was 
indeed the case that ACT proved to be a better predictor of the 
NTE scores than QPA. For example, ACT alone produced an R 2 of 
.62 when regressed ok the General Knowledge score (Table 5). 
This may have implications for student recruitment — it appears 
that the NTE reflects that ability students bring to the program 
(strong relationship to ACT) to a greater extent than it reflects 
what is learned (weaker relationship to GPA) . 
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Correlation and regression analysts vara performed on the 
data oollaotad sinoa 1982 and ainilar rasults vara found. Tha 
strongaat oorralation ia that batvaan tha OK aaotion of tha NTE 
and tha ACT compos its soora at .79 (Tabla 6). ACT ia also tha 
battar pradiotor of NTE parformanea (Tabla 7). 
Conclusion 

With all tha critical attention to education in recent years 
there has been a demand for improvement in the field. One 
suggestion that is heard again and again is that better teachers 
are needed. OSU presently has a GPA entrance requirement of 2.25 
into its College wf Education. The College is considering 
raising this to 2.50. Our data indicate that a viser decision 
vould be to attract students vith higher ACT scores. The ACT is 
a better predictor of success on the NTE, a test all of our 
students nov must "pass" for certification. Besides this, those 
students in the past vho have failed to score at or above the 
Ohio cutoff mark, have had respectable GPA' s but lov ACT scores. 
This seems to indicate that recruitment of better students — as 
measured by their ACT scores — might be a more viable vay to 
improve the quality of our teacher candidates. 

Although this seems to be a logical conclusion from the data 
presented, it is based on the assumption that .higher ACT scores 
result in higher NTE scores vhioh then translates into a valid 
measure of teacher competency. It may vary veil be the case 
that, vith the NTE and ACT ve have little more than tvo measures 

ERIC 9 



NTE 
8 

of general academic ability and test taking competency. Much has 
baan written questioning tha pradiotiva validity of tha NTE 
(Madaus and Fullin, 1987; Zimpher, 1990). Many in tha College of 
Education at OSU do not approve of the use and interpretation of 
the NTE and have recommended that a mora comprehensive student 
assessment program be developed, one that better matches the 
College's needs and philosophy and one that is more valid and 
ethical for the students (Zimpher, 1990; Shulman, 1987). It is 
beyond the scope of this paper to discuss the direction these 
authors propose, but several salient features deserve mention. 

Shulman 's work on the Teacher Assessment Project attempts to 
"mirror as accurately as possible tha complexity and richness of 
teaching 11 (p. 39). Evaluation and assessment programs must 
reflect this view of teaching, shulman seas teacher assessment 
as a formative and aummative procedure including: written 
assessments, exercises from assessment centers, documentation 
from supervised field experiences, and evidence from direct 
observations provided by trained observers. Such a portfolio 
could contain paper and pencil measures of content knowledge and 
basic skills , but would go well beyond this by describing the 
context and content of a given learning situation along with the 
teacher 'a behavior. Shulman 'a work is encouraging and at least 
two states — California and Connecticut — are pursuing this 
avenue of teacher assessment. And despite the Ohio legislature* s 
recent adoption of the NTE teacher certification test, there are 
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those working for a nore comprehensive assessment program in Ohio 
as wall. 
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Table l 

Description of 1988-89 NTE Sample 



Sample 

Sex N % 



Female 


62 


69 


Male 


28 


31 


Total 


90* 


100 



* N*91. 1 respondent's sex not reported 



Degree 


Samole 


Status 


N % 


Bach. 


82 91 


Postdegree 


8 9 


Total 


90* 100 



*N«91. 1 respondent's status 
not reported 



Grade Point Average ACT Composite Score 

N 91 N 57 

Hean 3.23 Mean 22.76 

Standard Deviation .44 Standard Deviation 7.69 

Minimum 2.12 Minimum 13 

Maximum 4.00 Maximum 31 



Table 2 

Description of Ohio State Students Reporting NTE Scores, 

1982 - 1989 Samples 



1982-83 


1983-84 


1984-85 


1985-86 


1986-87 


1 

1987-88 


1988-89 


Sex 














• 


Male 


20% 


14% 


18% 


13% 


19% 


19% 


31% 


N 


16 


14 


13 


12 


11 


7 


28 


Female 


80% 


86% 


82% 


87% 


81% 


81% 


69% 


N 


63 


85 


61 


80 


48 


30 


62 


GPA 
















N 


79 


76 


77 


91 


59 


38 


91 


Mean 


3.19 


3.15 


3.13 


3.13 


3.18 


3.03 


3.23 


S.O. 


.40 


,37 


.41 


.39 


.39 


.40 


.44 


Minimum 


2.39 


2.39 


2.37 


2.41 


2.43 


2 39 


2 12 

LI lL 


Maximum 


3.95 


4.00 


3.95 


3.94 


3.96 


3.83 


4.00 


ACT Composite 
















N 


56 


40 


54 


46 


40 


27 


59 


Mean 


22.11 


20.18 


20.76 


20.17 


21.75 


22.00 


22.76 


S.D. 


3.81 


4.53 


4.27 


4.61 


3.85 


4.79 


4.08 


Minimum 


13 


11 


10 


12 


12 


14 


13 


Maximum 


31 


30 


30 


29 


29 


31 


31 
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Table 3 

Summary Report of NTE Results, 1982-1989 Samples 



Sample Size 


1982-83 


1983-84 


1984-85 


1985-86 


1986-87 


1987-88 


1988-89 


Total 


Professional 


79 


99 


81 


83 

WW 


44 


30 


76 


492 


Knowl edge 


















Communication 




44 


79 


85 


44 


28 

mm W 


80 

Ww 


360 

www 


Skills 














General 








59 


47 


29 


80 


215 


Knowl edge 
















Variables 


1982-83 


1983-84 


1984-85 


1985-86 


1986-87 


1987-88 


1988-89 


Total 

■ W WW 1 


Mean GPA 


3.19 


3.15 


3.13 


3.13 


3.18 


3.03 


3.23 


3.16 


Mean ACT 


22.11 


20.18 


20.76 


21.17 


21.75 


22.00 


22.76 


21.55 


Professional 


















Knowledge Score 


665.16 


662.96 


663.19 


664.66 


664.20 


666.13 


667.04 


665.39 




72%11e 


64%11e 


647.1 le 


727.1 le 


687.1 le 


72%11e 


73%1 1 e 


68%11e 


Communication 


















Skills Score 




663.18 


665.15 


667.33 


665.07 


664.71 


668.80 


665.54 






567.11 e 


627.1 le 


687.1 le 


627.1 le 


6l7.1le 


74%1le 


63%11e 


General 


















Knowledge Score 








664.90 


663.96 


665.00 


669.06 


666.53 










727.1 le 


657.1 le 


66%11e 


77%1le 


70%1le 



Note: Specialty Area tests are not summarized because each test has Its 
own normative distribution. 
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Table 4 



Correlations Among 1988-89 Sample 
Academic Performance Variables 



GK 



PK 



SA 



GPA 



ACT 



CS 
GK 
PK 
SA 
GPA 



.70* 



.70* 
.64* 



.43* 
.58* 
.38* 



.30* 
.28* 
.51* 
.12* 



.65* 
.78* 
.44* 
.38* 
.03 



* p * .05 

CS » Communication Skills exam 

GK - General Knowledge exam 

PK - Professional Knowledge exam 

SA - Specialty Area exam z score 

GPA - grade point average 

ACT - American College Test composite score 

Number of observations ranged from 50 to 76. 
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Table 5 

Predicting General Knowledge Scores from 
ACT Composite Scores, 1988-89 Sample 



Source 


df 


SS 


MS 


F 


P 


ACT 


1 


13.03 


13.03 


84.85 


.0001 


Error 


53 


8.14 


.15 






Total 


54 


21.17 









R 2 ■ .62 



<8 



Table 6 



Correlations Among Academic Performance Variables, 
1982 - 1989 Samples Combined 





GK 


PK 


SA 


GPA 


ACT 


CS 


.73 


.68 


.54 


.39 


.72 


GK 




.66 


.58 


.43 


.79 


PK 






.10* 


.35 


.45 


SA 








.34 


.54 


GPA 




• 






.41 



* significant at p <.05. All other correlations are significant, 
P4.0001. 



CS- Communication Skills exam 

GK- General Knowledge exam 

PK- Professional Knowledge exam 

SA« Specialty Area exam z score 

GPA- grade point average 

ACT- American College Test composite score 

Number of observations ranged from 143 to 468. 
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Table 7 

Predicting General Knowledge Scores from ACT Composite Scores 

1982 - 1989 Samples Combined 



Source 


df 


SS 


MS 


F P 


ACT 


1 


41.26 


41.26 


239.44 .0001 


Error 


141 


24.29 


.17 




Total 


142 


65.55 







R 2 - .63 
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